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Abstract. An Ito-Skorokhod bi- linear equation driven by infinitely many indepen- 
dent colored noises is considered in a normal triple of Hilbert spaces. The special 
feature of the equation is the appearance of the Wick product in the definition of 
the Ito-Skorokhod integral, requiring innovative approaches to computing the solu- 
tion. A chaos expansion of the solution is derived and several truncations of this 
expansion are studied. A recursive approximation of the solution is suggested and 
the corresponding approximation error bound is computed. 



1. Introduction 

Stochastic differential equations driven by Gaussian white noise are well-studied; see, 
for example, the book [35j for ordinary differential equation and the book [37] for equa- 
tions with partial derivatives. The underlying stochastic process in these equations is 
the standard Brownian motion W, which is a square-integrable Gaussian martingale 
with continuous trajectories and independent increments. A lot less is known about 
equations driven by colored noise, when the underlying process is still Gaussian, but 
no longer has independent increments. An important example is the fractional Brow- 
nian motion , H G (0,1), which coincides with the standard Brownian motion 
W for H = 1/2 and is not a semi-martingale for all H ^ 1/2. It is the lack of the 
semi-martingale property that makes the analysis difficult at the very basic level, the 
definition of the corresponding stochastic integral. Several versions of the stochastic 
integral with respect to have been proposed [H [HI [131 [H [231 [261 [38] • Unlike the 
standard Brownian motion, different approaches such as Ito-type vs. Stratonovich- 
type integral or path-vise vs. mean-square definition, become much more difficult to 
reconcile. The paper by V. Pipiras and M. Taqqu [36] describes the main difference 
between integration with respect to W and for H ^ 1/2, and demonstrates the 
resulting technical difficulty. Beside a purely theoretical interest, fractional Brown- 
ian motion appears to be a natural replacement of the standard Brownian motion in 
certain applied problems [SI [H [SI [SI [13 [22] • In many such problems, it is possible to 
avoid most of the technical issues related to the definition of the stochastic integral 
by considering additive noise. 
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One way to streamline the analysis of differential equations driven by multiplicative 
noise (also known as bilinear equations) is to use the Wick product. It is known 
[TH] that, with standard Brownian motion, Wick product and usual calculus lead to 
the same results as the usual product and the Ito calculus. While the use of Wick 
product has been questioned as a modeling tool for certain applications in economics 
and finance [8] , it is still an effective tool for theoretical investigations, corresponding 
to the Ito-Skorokhod integral in the white noise analysis. 

Successful study of differential equations driven by multiplicative colored noise also 
requires a convenient representation of the underling Gaussian process. Traditionally, 
a Gaussian process is defined by its mean and covariance functions, but then the 
definition of the integral immediately leads to a number of technical conditions on 
these functions [2]. An alternative definition is possible [29] by combining the ideas 
from the theory of generalized Gaussian fields [151 EO] , the white noise theory [TTl [18] , 
and the Malliavin calculus [HI [S^ . This approach to stochastic integration is used 
in this paper and is outlined in Section [2] 

Numerical methods for stochastic ordinary differential equations driven by white noise 
are a well-developed subject [211 122] ■ Equations with partial derivatives have been 
mostly studied in connection with optimal nonlinear filtering [HI H [121 [201 121] • In the 
end, all these numerical methods have obvious counterparts in the numerical analysis 
of the deterministic equations (Galerkin method, Euler method, finite difference and 
finite element methods, operator splitting method, etc.) 

The main difficulty in the numerical analysis of equations driven by colored noise 
is the use of the Wick product: unlike the usual product. Wick product is not an 
operation readily performed by a computer. Since the Wick product is relatively easy 
to compute for Hermite polynomials of Gaussian random variables, an implementation 
of this operation should be based on the chaos expansion, and then a truncation of 
this expansion becomes a natural numerical approximation of the solution. 

While a truncated chaos expansion has been investigated before as an approximation 
of the solution of a stochastic equation, in particular, for equations of optimal non- 
linear filtering [TOl 123, etc.], this approximation was always just another possibility 
of solving the equation numerically. By contrast, for equations driven by colored 
noise, chaos expansion appears to be the only possibility to compute the solution. 
The chaos expansion of the solution of a bi-linear equation driven by infinitely many 
independent colored noises is studied below in Section [31 various truncations of this 
expansion are studied in Section [H 



2. Colored Noise 
Let {Q, JF, P) be a complete probability space. 

Definition 2.1. (a) A colored noise X on L2{{0,T)) with the covariance operator 
7?. is a collection of zero-mean Gaussian random variables X(/), / G L2((0,T)), with 
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the property 

(2.1) E(x{f)X{g)) = j\nf){s)g{s)ds, /, g E L2((0,T)), 

where 7?. is a bounded hnear operator on L2((0,T)). 

(b) A representation operator of X is a bounded hnear operator /C on L2((0,T)) 
such that /C/C* = TZ, where /C* is the adjoint of /C. 

Remark 2.2. (a) The white noise on L2((0, T)) corresponds toTZ = I, the identity 
operator [T7J. 

(b) Since 7^ is a self-adjoint non-negative operator, a representation operator always 
exists. 



For t > let 

'l, 0<s<t, 
0, otherwise, 

denote the characteristic function of the interval [0,t]. 



Xt(.s) 



Example 2.3. If X is white noise, then direct computations show that W{t) = X{xt] 
is a standard Brownian motion and 

(2.2) X(/) = r f{s)dWis), f e L2((0,T)). 



^0 

Example 2.4. (Ornstein-Uhlenbeck Noise) 

For 6 > and t,s e [0, T] define 

K{t, s) = -he-^^'-'\ 

Then the operator 

/C : fit) ^ (/C/)(t) = fit) + f Kit,s)fis)ds 

Jo 

is bounded on L2((0,T)): 



|(/C/)(.)|^ds<(l + V6T)^ / \fis)\'ds. 

'0 ^0 

If X is the colored noise corresponding to the representation operator /C, then a 
straightforward computation shows that X(xt), t G (0,T), is the Ornstein-Uhlenbeck 
process with covariance 

E(X(xt)X(xs)) =e-''l*-^l. 
Accordingly, we call X the Ornstein-Uhlenbeck noise with parameter b. 

Example 2.5. (Fractional White Noise) 

For H e (1/2, 1) and t,se [0, T] define 

Kit,s)=CH(H~^-^ 0y ''(t-3)^-^Xt(^), 
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where 

2Hr (I - H) 



c 



and r is the Gamma function. Then the operator 

/C : /(t) ^ (/C/)(t) = f K{t,s)f{s)ds 

Jo 

is bounded on L2((0, T)) [291 [33]: 

(2.3) £ \{ICf){s)\'ds < ""^'^(1^^!^"'^ r 

If X is the colored noise corresponding to the representation operator /C, then 
X(xt), i G (0,T), is the fractional Brownian motion with Hurst parameter H j33] . 
Accordingly, we call X the if-f ractional white noise. 

In general, if X is a colored noise on L2((0,T)), then X(t) = X(xt) is a zero-mean 
Gaussian process. Thus, one can interpret X as a collection of integrals f{s)dX{s) 
for deterministic f G L2((0,T)). Our study of bi-linear equations (linear equations 
with multiplicative noise) requires an extension of X to random f and is based on the 
following generalization of (12. 2p . 

Proposition 2.6. For every colored noise X on L2((0,T)) with a representation 
operator JC, there exists a unique standard Brownian motion W = W{t) such that 

(2.4) X(/) = r{IC*f){s)dW{s), f e L2((0,T)). 

Jo 

Proof. Relation (12.41) certainly defines a colored noise on 1/2 ((0, T)); we omit the tech- 
nical proof that the corresponding Brownian motion can be found for every colored 
noise X [29j. □ 

Definition 2.7. A pair {JC, W), where /C is a bounded linear operator on L2((0,T)) 
and is a standard Brownian motion, is called a representation of the colored 
noise X if ([231) holds. 

For random /, we now define X(/) according to (12. 4|) . where the stochastic integral 
is understood in the Ito-Skorokhod sense |3l|. A equivalent, but less convenient, 
definition of X(/) for random / is possible in intrinsic terms without using a repre- 
sentation of X l29l. 



3. Chaos Solution: Existence and Regularity 



Let (fi,jF, P) be a complete probability space and X^, £ > 1, a collection of indepen- 
dent colored noises on L2((0,T)). 
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In this section we study the equation 

(3.1) u{t) =uo+ iAu{s) + F{s))ds + J2 MXtBeu + XtGe), 

Jo 

t G [0,T], in a normal triple (X,H,X') of Hilbert spaces. In particular, we assume 
that A and each are bounded linear operators from X to X', uq G L2(fi;X'), 
F,G,GL2(fi;L2((0,T);X')). 

Remark 3.1. While it is tempting to re-write (13.11) as 

(3.2) u{t)=uo+ / {Au{s) + F{s))ds + Y^ / {Biu{s) + Geis))dXeis), 

Jo Jo 

where Xi(t) = Xe{xt), "we will use a more rigorous form (13.11) . 

By analogy with equations driven by white noise |37,|, we define a variational 
solution of (13. ip as a random element u with values in L2(f2; Iv2((0, T); X)) such 
that, for every G X, the equality 

ft oo 

(3.3) iu{t),v)H = {uo,v)+ {{Auis) + F{s)),v)ds + Y,Mxt{l3eu + Gi,v)) 

holds in X' on the same set of probability one for alH G [0, T]; by (-, ■) we denote the 
duality between X' and X relative to the inner product (-, ■)h of H. 

Unfortunately, the current development of the colored noise calculus is not sufficient 
to establish existence of a variational solution of (13.11) . Accordingly, we introduce a 
weaker notion of solution, called a chaos solution., using a Fourier series expansion in 
the space of square integrable random processes. 

We start with some auxiliary constructions. Let (/C^, We) be a representation of the 
colored noise and let {hk, k > 1} he an orthonormal basis in L2((0,T)). Define 
random variables 

(3.4) iki= C hk{t)dW,{t). 



Let J be the collection of multi-indices a = {ake, k,i > 1}. Each a ^ J has 
non-negative integer elements a^^i and 'Yliki'^kt < oo. We will use the notations 

(3.5) |a| = ^ake, a\ = J^a^!. 

k,e k,e 

By (0) we denote the multi-index a with |a| = and by e^j, the multi-index a with 
\a\ = 1 and aij = 1. 

Remark 3.2. If there is only one colored noise, then the entries of a have only one 
index: a = {a^, k > 1}. 

For a ^ J define 



(3.6) = n 



kl> 
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where, for an integer n > 0, Hn = Hn{t) is the n-th Hermite polynomial 

Jn 

(3.7) H^it) = (-l)"e*^/^|^e-*V2. 

Recall the definition of the Wick product [T8] : 



(3.8) H^{i,^)oHn{i 



Hm+n{^ij), if i = k and j 

H^{^ij)Hn{^ke), otherwise. 



In particular, for m > 1, 

(3.9) Hmi^ki) = ikio - ■ -o^M- 



Then every multi-index a is uniquely characterized by the collection 

{(fci, ^i), . . . , (/c„, £„)}, called the characteristic set of a, such that ki < k2 < 

■ ■ ■ < kn, ii < ii+i if ki = ki+i, and 

^2 -j^Q^ ^ ^ ^kih O ^fc afe o ■ ■ ■ o ^kni„ 



Proposition 3.3. (a) The collection {C,a, a G JT} is an orthonormal basis in the 
space of square integrable random variables that are measurable with respect to the 
(7-algebra generated by the Brownian motions Wg, £ > 1, on [0, T]. 

(b) Let 1] he a. square-integrable jF'^-measurable random element with values in 
L2((0,T)). Define 

(3.11) Va{t)=E{r]kit)U- 
Then 

r-T 



(3.12) X,{v) = J2{j2^^ f 

adj \k>l "'O 



r]a-eki{s){JCmk){s)ds 



as long as the series in a converges in the mean square (the inner sum always contains 
finitely many non-zero terms). 

Proof. Part (a) is a classical result of Cameron and Martin [llj. Part (b) follows from 
the definition of the Ito-Skorokhod integral in terms of the Wick product ^29j . 

□ 



Let us now assume that equation (13.11) has a variational solution u and 
(3.13) u{t) = J2MtKa. 
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Substituting this representation into (13.11) and using (I3.12p . we conclude that each 
Ua, which is non-random, satisfies 



(3.14) 



^0 

CXD I 

+ ^ y/Oki / {l3eUa^e^,e{^) + G i^a-eu{s)){K:ihk){s)ds, 



where Mo,a = E(mo^q-), Fa(t) = K{F{t)^a), Ge,a(t) = K{Ge{t)^a)- This observation 
motivates the following definition of the chaos solution. 

Definition 3.4. (a) The collection of functions {ua, oi G is called a chaos 
solution of equation (13. ip if every is an element of L2((0,T);X) and the system 
of equalities (13.140 holds in X' for all t G [0,T]. The chaos solution is called square 
integrable if 

(3.15) sup ||M„(t)||^ < oo. 

0<t<T ~L 

(b) The system of equalities (I3.14p is called the S-system corresponding to equation 

Remark 3.5. (a) If {uq, a G J7} is a square integrable chaos solution, then, for 
each t G [0,T], ^(t) = Xlaej is an element of L2(fi;H), but still there is no 
guarantee that m is a variational solution. 

(b) Uniqueness of the chaos solution implies uniqueness of the variational solution. 

To establish existence and uniqueness of the chaos solution, we look at (13.10 as a 
system of equations. To solve this system, we make the following assumptions: 

Al The operator A is bounded linear from X to X' and is strongly parabolic: 
there exist a positive number 5^ and a real number Ca such that, for all f G X, 

(3.16) ^Av,v) ^ bAM\<CA\\vf^. 

A2 Each X^, l> 1, is a colored noise on L2((0, T)) with a representation operator 
/C^ and each /C^ is a bounded linear operator on L2((0,T)) with the operator 
norm : 

(3.17) r \{ICJ){s)\'ds<^l r fis)ds, /GL2((0,T)). 
Jo Jo 

A3 The functions uq, F, Ge, i > 1, are non-random and Xe, i > 1, are jointly 
independent. 

A4 Each Bg is a bounded linear operator on H with the operator norm Cf. 

(3.18) ||i3,^;||H < CMn, veU. 
A5 The following regularity conditions hold: 

(3.19) /o = ||«o||^ + |_ /■ \\F{t)f^,dt + J2^U \\Gimudt<oo, 

Jo t:f Jo 
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(3.20) Cb = J2^^eCe <oo. 

£=1 

Theorem 3.6. Under Assumptions A1-A5 equation fl3.ll) has a unique chaos solu- 
tion. The solution is square integrable and satisfies 

(3.21) sup E||n(t)||^ < ae(^^+^^)%, 

0<t<T 

where Ca > is from (13.161) and 1 < Co < 3. In particular, Co = I if F = Gi = 0. 

Proof. Under Assumption A3 the the S-system (13.141) corresponding to equation (13.11) 
becomes 

M(o)(t)=Mo+ / Au(^o){s)ds + / F{s)ds, |a| = 0; 
Jo Jo 

(3.22) = Au,^^{s)ds + [BjU(Q){s) + Gj{s)^{lCjhi){s)ds, \a\ = 1; 

Ua{t) = / Auais)ds+ y/a^e / BiUa-ekeis){}Cihk){s)ds, \a\ > 1. 

^0 /, 1 Jo 



k,i=l 



Indeed, by Assumption A3, if |a| > 0, then E('Uo^a) = 0, E(F(t)^a) = 0, and 
E{GeU = 0. 

The following proposition provides a key estimate for the solution of this system and 
is the main step in the proof of Theorem | 



Proposition 3.7. Under Assumptions A1-A6, for every < t <T and k > 1, 

E \Kmh<Coe'^^''(^^jP^ (ikoll^ + f r\\F{s)\\Us 
(3.23) l"l=^ 



(CbTY 

{k 



+ ^-^ 1), E-^'/ \\G,{s)\\i,ds\. 



Proof. Given ^ H and ip G L2((0,T); X'), consider a deterministic evolution equa- 
tion 

(3.24) v(t)=VQ+ [ {Av{s) +'^{s))ds. 

Jo 

By definition, v e L2((0,T);X) is a solution of flX^ if equality flX^ holds in X' 
for every t E [0, T]. 

It is known [37j Theorem 3.1.4] that, if the operator A is strongly parabolic, then 

• The operator A generates a semigroup $ = <I>i, t > 0, in the space H. 

• The semigroup $ has the following properties: 

(3.25) ||**^||H<e^^*l|t;ll^, veU; 
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<^t-sf{s)ds 



H 



2 



f\\fis)\\Us, /GL2((0,T);X'). 
Jo 



The solution of (13.241) is unique and can be written as 
v{t) = ^tvo + [ ^t-s^{s)ds. 



(3.26) 



(3.27) 



We use these results to study the system of equations ( 13.22p . It follows by induction 
on |a| that if |a| = k with the characteristic set {{ii,£i), . . . , {ik,£k)}, and Vk is the 
set of all permutations of {1,2, . . . , k}, then the solution of (I3.22p is unique and is 
given by 



(3.28) 



Ua{t) 



1 



'al 




JO 



S2 



+ G,^,,,(.i))(/C, 



,7(1) ■-'^{1). 



We then re-write (13.281) as 



(3.29) 
where 

(3.30) 

and 
(3.31) 



[0,T]'= 



" 5Z (^hK)i.Sa{l)) ■ ■ ■ (/C4/liJ(s^(fc)). 



From (I3.29P and the definition of the function H, we conclude that 



(3.32) 



£i,...,4=i \i=i 



|a|=A: 



S2 



(isi . . . dsk- 



By f l3:22|) and ([32ZD, 

(3.33) u^o){t) = ^tUo+ [ ^t-sF{s)ds, 

Jo 

and then the properties fl3.25p and (I3.26P of the semigroup $ imply 



||i3,n(o)(t)+G',(t)|||i<CJC,V 



0/ 



||F(.)||^,rf.+ ||G,(t)||^ 
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where Co = 3, as the inequahty (a + 6 + c)^ < 3(a^ + + c^) suggests. On the other 
hand, Co = 1 if -F = = 0. Applying (13.251) repeatedly, we find 

(3-34) \ / 

Inequality (13.231) now follows from (I3.32p . 

Proposition 13.71 is proved. □ 

To complete the proof of Theorem 13.61 it remains to note that uniqueness of the chaos 
solution is equivalent to the uniqueness of the solution of (13.22^ and is guaranteed by 
the strong parabolicity of the operator A. Then 

(3.35) ii^-WIIh = ii^(o)Wii^ + E E ii^-WIIh' 

a&J k>l a&J 

\a\=k 

and fl3:2T]) follows from ([323]) ■ □ 

As a first step toward studying the approximation of the chaos solution, we get 
Corollary 3.8. Let F = = and, for > 1, define 

(3.36) UN{t) = ^ Ua{t)ia- 

\a\<N 



Then 

(3.37) sup nu{t) - UM{tWu < e(^^+^^)^||txo||^- 

0<t<T (iV + ij! 



Proof. We have 

(3.38) E||M(^)-n^^(^)||^= ^ \Kmli, 



because 

(3.39) E{Up) 



|a|>Ar+l 



1 if a = (3, 
otherwise. 



Then (Km follows from (Km . □ 

Remark 3.9. The conclusions of the theorem are valid even if the operators A, Be 
depend on time in a sufficiently regular way, as long as Assumptions Al and A3 hold 
uniformly in t G [0,T]. 

There are at least two open problems related to the chaos solution of equation (13. ip : 
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(1) To find out whether the solution belongs to 

L2(^]; L2(0, T); X)) f| L^i^- C((0, T)-H))- 

this is true when every Xi is a white noise over L2((0,T)) [28l Theorem 3.8]. 

(2) To establish existence of the solution when the operators Bi are unbounded 
on H. 

4. Approximation of the Chaos Solution 
4.1. One-step Approximation. 

4.1.1. Motivation. If V is a Hilbert space, / G V, and {m^, A; > 1} is an orthonormal 
basis in V, then 

l(/'"^fc)vP < oo, 

k>l 

but nothing can be said about the rate of this convergence, that is, about the rate at 
which 



|2 



k=n 

tends to zero as n ^ oo : taking V = L2((0,T)) with a trigonometric basis, one can 
construct a function for which this convergence will be arbitrarily slow. 

In the study of the chaos solution, we are facing a similar problem. In fact, the 
underlying Hilbert space is the space of square integrable random processes, the study 
of the rate of convergence for the "natural" approximations of the chaos solution is 
reduced to the analysis of certain Fourier series in ((0, T)). 

As an illustration, consider the following equation: 

(4.1) u{t,x) = UQ+ I u^xi-s, x)ds + X{xth{-, x)u{-, x)), t > 0, a; G M, 

Jo 

where X is a colored noise on L2((0,T)) with representation (/C, W). 

If Mo G L2(M) is non-random, and h = h{t,x) is a bounded non-random function, 
then Theorem 13.61 on page [8] implies that (14. ip has a unique square-integrable chaos 
solution u(t,x) = 'Ua(t,x)^a, where 

~Qf - Q^2 ' "(o)lU,a;j - Uo[x), 

(4.2) d'^u °° 

— ^ = + '^y/a^hua-ek}Cmk, Ma(0,a;) = 0, |a| > 0, 
fc=i 

and {ruk, A; > 1} is an orthonormal basis in L2((0,T)); with only one colored noise 
driving the equation, every multi-index has the form a = {ai, a2, ■ ■ ■}■ 

Denoting the heat semigroup by we find 

(4.3) M(o)(t) = ^tuoix) 
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and 

(4.4) u^^{t,x)= / ^t-sh^sUo{s,x){JCmk){s)ds. 

Jo 

Let us define an approximation u'^{t,x) of u{t,x) by 

n 

(4.5) Ui{t,x) = U(o){t,x) + ^Ue^{t,x)^k- 

k=l 

Wfiat can we say about tlie quality of this approximation? For example, can we find 
a bound on supg^^^j. E||m — u^\W^(-^'jit) in terms of n and T? 

Since u{t,x) = Ua{t,x)^a and (I3.39p holds, we have 



oo 



(4.6) E||M-<iii^(j,)(t) = ii^aiiL(M)W+ ii^^JiLwW- 

a€l, \a\>l k=n+l 

Using the properties of the heat semigroup on M and Corollary 13.81 on page [lO], we 
find 



(4.7) sup \Ml(R){t) < {CBTye 

°<*<^aex^|>i 



where Cb = ||/C|| sup \h(t, x)\'^. 

t,x 

As a result, to find the quality of the approximation, we need to find the rate of 
convergence of the series J^'kLi ll'"<:t.|li2(K)(^)- "^^^^ ^^^^ convergence is determined 
by the rate of decay, as — > cxd, of ||'Uei.||i2(R)(^)' equality (14. 4p suggests, one 

way to determine this rate is to integrate by parts. Accordingly, setting 

(4.8) Mk{t)= [ {}Cmk){s)ds, 

Jo 

and using the properties of the heat semi-group, we get 

. — , s=t 

u,^{t, x) = $i_s(/i(s, ■)u(^o){s, ■)){x)Mk{s) 

(4.9) , _ 

XX 

Note that (14. 8 p and the Cauchy-Schwartz inequality imply 

(4.10) |Mfc(t)|<Cv^, 

and so Mfc(O) = 0. Still, to advance our study of the rate of convergence any further, 
we need 

(1) additional regularity of mq and h] 

(2) a rather detailed information about the functions M^. 
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If we indeed assume all the necessary regularity of uq and h, then (14.91) . together with 
the Cauchy-Schwartz inequality, implies 

2 



(4.11) lk.J|t(i,)(t) <Ci||«o|li(M)|Mfc(t)|^ + C2 
To continue, assume that 



t I \Mu{s)Yds. 

L2(K) 



(4.12) m,{s) = ^- m,it) = ^ cos (^^^^^j^],k> I; 0<t<T. 



With this choice of the basis, we use (14.81) to find that, for A; > 1, 
(1) If X is white noise (/C = /), then 



(4.13) Mfc(t) = — ^ -sin' ^ ' 



7r(A;-l) V T 
(2) If X is the Ornstein-Uhlenbeck noise with parameter 6, then 

(4.14) 

^(^-l)7r^.^/7r(A:-l)t 



T V ^ 

(3) If j£ the if-fractional white noise and 1/2 < < 1, then 

(4.15) \Mm< ^^\_J — 

K 2 

for some number C{H) depending only on H. 

Relation (14.111) suggests that the rate of convergence will be quite different for different 
X, and we are essentially forced to make the following assumptions about the functions 

(4.16) sup |Mfc(t)|2 <C — for 5 > 0, 7 > 1, C > 0, 



0<t<T 



(4.17) |Mfc(T)p<C— for5i>0, 7i>l, C'>0. 

In both (I4.16P and (I4.17p . the number C should not depend on T or k. 

It is enough to have (14.161) and (I4.17P for some orthonormal basis {m^, > 1} in 
L2((0,T)), but for now the cosine basis (I4.12p is the only example when these as- 
sumptions can be verified. Below, we summarize the results for the white noise W , 
fractional white noise , 1/2 < if < 1, and the Ornstein-Uhlenbeck noise t/fe, 6 > 0, 
when the cosine basis (I4.12p is used. 



Remark 4.1. (a) In the case of W , with as in (14.120 . we have Mk{T) = for all 
k > 2, and then indeed any choice of 6i, 71 will work in (I4.17p . 
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Table 1. 





s 


7 


Si 


7i 


w 


1 


2 


Any 


Any 




2H 


3-2H 


2H 


3-2H 




1 


2 


3 


4 



(b) Inequality (14.111) shows that assumptions fl4.16p and f l4.17p are close to necessary 
for the analysis of convergence of the chaos expansion. 



(c) As equality (14.91) suggests, no further integration by parts will, in general, improve 
the rate of convergence. 



Under assumption (14.160 . we conclude from (14. lip that, for n > 1, 



(4.18) 



oo 

sup > IIM 



0<t<T 



k=n 



<5fc ll-L2( 



< Cill^o 



rpS 



-1 



L2( 



With assumption (I4.17p . we also get 



(4.19) 



E 

k=n 



\U 



Efc \\L2{ 



,(T)<Ci||no 



|2 

IL2( 



+ C2 



1-2 ( 



Inequality (I4.18P establishes an approximation error bound uniformly over the time 
interval (0,T), while (I4.19P gives the bound only at the end point. If T is small, 
and if we can take > 5, 71 > 7, which is the case for X = 03 and X = then 
(I4.19P provides a better error bound than (14.180 and is more suitable for analyzing a 
step-by-step approximation. 



By combining (14. 7p with either (I4.18P or (I4.19p . we will get the overall bound on the 
approximation error; for white, fractional, or Ornstein-Uhlenbeck noise, we also use 
Tabled For example, when X = , 1/2 < H < 1, we have ||/Cf < C{H)T^"~^ 
(see Example 12. 5[ page [3]) and therefore, for T < 1, 



(4.20) 



sup K\\u 

0<t<T 



U 



n\\2 
1 \\L2{ 



At) <C* (T^^ + 



T 



2H 



2~2H 



n 



In the next section, we extend this result to more general equations and more general 
approximations . 
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4.1.2. Truncation of the S-system. Consider the following evolution equation: 



(4.21) 



u{t) = uo+ Au{s)ds + ^Xi{xt}3iu), 
Jo 



and assume that this equation has a unique square-integrable chaos solution m in a 
normal triple (X, H, X') of Hilbert spaces. We also assume that u has chaos expansion 



(4.22) 



u 



As before, we assume that uq is deterministic and every colored noise has a repre- 
sentation {ICe,Wi). 

The fist step is to find a general method of constructing an approximation of u given 
the expansion (14.221) . A natural approximation is 



(4.23) 



u 



where JT" is a finite subset of J^. To control the size of this finite set, we use three 
characteristics of a multi-index: 



\a\ 



'Y^aki, zu^a) = raax{k : ak£ > 0}, d{a) = max{i : aki > 0}. 



For example, if 



a 



/101000300---\ 

1 2 O--- 

1 O--- 
00000000 o--- 



v 



then |«| = 1 + 1 + 3 + 1 + 2 + 1 = 9, w{a) = 8, d{a) = 3. We call |a| the length of 
the multi-index, w{a) the order of the multi-index, and d{a) the dimension 
of the multi-index. Then the set 

J7^'^ = {a e J : \a\ < N, zu{a) < n, d{a) < r} 

is finite, with no more than {nr)^ elements. Note that the sets Jn = {a & J :\a\ < 
N} is always infinite, and the set = {a & J : \a\ < N,zu{a) < n} is infinite if 
and only if there are infinitely many noises in the equation. Accordingly, we define 
three approximations of u: 



(4.24) 



UN 



aejN 



^ rT"r\ 



Of the three, only u^^' {t) is computable, being a sum of finitely many terms. Conse- 
quently, our goal is to find a bound on sup E||u(t) — u^'"(t)||H- Recall (see fl3.14p on 

0<t<T 
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page [71) that the coefficients Ua satisfy the S-system 



(4.25) 



■U(o)(t)=Mo+ / Au^Q){s)ds, |a| = 0; 
Jo 

[t] = / Aua{s)ds+ y2 / BiUa-euis) {lCmk){s)ds, \a\ > 0. 

-^0 k,e=i 



By orthogonahty of C,a for different a, we have 



(4.26) "^^^'^ "^^^^^ 

+ E E||M,(t)||^+ E ^\M)\\h, 

where \ denotes the difference of two sets. In other words, we have an analogue of 
the Pithagorean theorem: 

^ ■ ^ +nui{t)-u-^\t)\\i,, 

and Corollary 13. 8t page[TU], provides an estimate for IE||'u(t) — w^r(t)||H• 
As we saw in the previous section, to estimate E||MAr(t) —u%{t)\\'^, we need to assume 
(14. 16p and (14.171) together with additional regularity of the initial condition uq and the 
operators A, Bg. To formulate this regularity we need some additional constructions. 

Let H*^, r G M be a scale of Hilbert spaces, or a Hilbert scale [251 Section VI.1.10] 
with the property that H° = H, = X, = X'. A typical example of such a 
scale is the collection of the Sobolev spaces 

(4.28) H^(M'^) = {/ : + \y\'rdy < ooj , 
where / is the Fourier transform of /. 

To generalize the computations that lead to (14.111) . we make the following assump- 
tions: 

(4.29) E||uo||h2 < oo, 

(4.30) \\Av\\l,<Co2\\v\\l,., ll^tt'llH. <e''^1^llL, J = 0,2, 

(4.31) BeBn = BnBi for all £, n, 

oo 

(4.32) WBfvf^, < ClAvfu-. V e H^, and E^iA' = ^^,b < oo. 



where $t is the semi-group generated by A. 
Theorem 4.2. Assume that 

• A1-A5 hold (see page\^; 

• Fit) = and d = 0; 



CHAOS SOLUTIONS 17 

• /ioW /or a// so that the numbers 6, ^i, 7, 71, do not depend on 

i; 

• (l2^-(l3g) hold. 

Then 

rpS 



(4.33) 



and 



(4.34) 



sup E\\uN{t)-uUt)\\n < Ci.Be'^''^+''^^^\CB—-rE\\uofu 
o<t<T ' \ ^ 

+ Co2Ci,B—^mUo\\'ii2 



'Wo||h2 



where Cb = niax(CB, Ci^^). 

Proof. The argument is based on integration by parts in the representation of Ua{t) 
(see f l3.29p on page [9]); while the idea and the end result are essentially identical 
to (14. 9p . the computations are rather long. An interested reader can recover these 
computations following [2^, where each j£ is white noise. □ 



Remark 4.3. Similar to [27J, a bound on E||u7v(t) — WAf(^)||H can be derived without 
condition (I4.3ip . that is, if the operators Be do not commute. 

Finally, we derive a bound on E||M^(t) — u^^it)]]"^. 
Theorem 4.4. Assume that 

• A1-A5 hold; 

• F{t) = and d = 0; 

Define the sequence e = e{r), r = 1, 2, . . . by 

(4.35) Yl ^"Cl=e{r). 
Then 

(4.36) sup E\\u%{t) - uj^\t)\\l^ < £(r)Te(^-^+^^)^E||Mo||H- 

0<t<T 



Proof. We have by (I3.32p on page 

k=l j=l lj=r+l ~ "'0^0 

W^t-sk^ik ■ ■ ■ ^s2-s^Bi^U(Q){si)\\l^dsi ...dsk 
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where the summation Yl^i-^ 4>i o^iits the index Ij. Using assumptions the theorem, 
we conclude that 

e=r+l J \k=l ' / 

which imphes (I4.36p . □ 

Remark 4.5. If there are finitely many X^, and all of them are included in the ap- 
proximation, then e{r) = and u^(t) = ulf{t). 

Combining the results of Corollary 13.81 and Theorems 14.21 and 14.41 we get the overall 
error bound: 

sup nnt) - u'lfmi, < cm { ^'f^i^.^' nuoru 

0<t<T \ {I\ + i)\ 

(4.37) ^ 

rpS rpS+2 

+ — yE||mo||h + --tEIImoIIh^ + Te{r)E\\uo\\'ii 



where lira C(T) > 0. A similar bound holds for E||m(T) — u^^i^T)]]"^: 



IpSl rpS+2 



E\\u{T) - uY{T)Wi, < C{T) ( Eho"^ 

(4.38) 



(iV + 1)! 



H 



+ — -^E||no||^ + ^nuo\\u2 + T£(r)E||^io||H 
Example 4.6. Consider the equation 

u{t) = Uq + Uxx{s)ds + X(x(-u), < t < T, X G M. 
Jo 

With only one noise driving the equation, we have u^f = u%. Also, H*" = H''(R) is 
the Sobolev space and H = L2(M). 



(a) If X is an Ornstein-Uhlenbeck noise with parameter 6, then Cb = (1 + vbTY 
5 = 1, 7 = 2 (see Tabled]). Inequality (14.371) becomes 

sup E||^(t) -«7(t)||^ < C,{T)r-^i^rh\, Ell^oll^ 

(4.39) ^ 

^^n ,,2 ^^^n ,,2 
+ — E Mo H H IE Mo H2 I ) 

n n ' 

where limsupCfe(T) > 0. 

(b) If X is an iJ-fractional white noise with H G (1/2, 1), then Cb = Ci{H)T 
where 

H(2H -1)T(H-^) 

(4.40) c,H) ^ r(;4) 



2H-1 



CHAOS SOLUTIONS 



19 



see (EJD on page H Also, 6 = 2H, = 3 - 2H (see Table ^. Inequality (Km 
becomes 

^ Ell^oll^ 

rp2H rp2H+2 \ 

+ ;^^II«oIIh + ;^E||«o||h2 J , 

where Urn sup Ch(T) > 0. 

4.2. Step-by-Step Approximation. 

4.2.1. Motivation. In the previous section, we constructed an approximate solution 
for equation fl4.2ip on the time interval [0, T] and derived an error bound. The error 
bound suggests that the quality of the approximation improves for small values of T. 
To construct the approximation for large values of T, it is natural to use a step- by-step 
method. 

The main idea of the step-by-step method is as follows. Let \E't be the solution 
operator for a homogenous linear evolution equation, that is, given an initial condition 
Mo, u{t) = \l/f'Uo is the solution of the equation at time t. If the equation is time- 
homogeneous (has no explicit dependence on time, such as fl4.2ip ) and the solution 
is unique, then the solution operator has the semi-group property: 

(4.42) ^tuo = *t-sM(s), t>s>0. 

If, for each t > 0, M(t) is an element of an infinite-dimensional Hilbert space X with 
norm || ■ ||, then a one-step approximate solution u{t) can be constructed by 

u{t) = n^^t^o, 

where 11^ is an orthogonal projection on an A^-dimensional sub-space of X. Assume 
that the approximation is of order j9/2 in time for some p > 1: 

(4.43) Wm - u{t)f = ||(/ - n^)vl/,Mof < Ct^uof, 

where / denotes the identity operator. To construct a multi-step approximation on 
[0, T], let = to < ti < ■ ■ ■ < tx = T he a. uniform partition of [0, T] with step r. 
Then define Ui, i = 0, . . . , K, recursively as follows: 

(4.44) Uo = Uo, Ui+i = U^'^rUi. 

For simplicity, we assume that the initial condition is not approximated, and con- 
centrate only on the effects of approximating the solution operator Then, by 
linearity, 

(4.45) U{ti)-Ui = ^rU{ti^l)-U''^rUi-l = (/ " H^) + H^^, (m,^_, - ) . 

By orthogonality, we find 

\\u{ti) ~Uif = \\^^u{ti^l) -U^^rU^^iW^ 
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Let Ai = \\u{ti) -Uif. Then ( KM\i and fl05D imply 

(4.47) A, < CTP\\ut^_^f + \\^Aur,_, -II.-i)f . 
In many situations, the semi-group satisfies 

(4.48) \\%f\\ < e^'WfW 

for some a > 0. In this case, HMtj.JP < e^^-^HwolP and ( I4.47P implies 

(4.49) A, <CirP||Mof + e'""A,_i, 
or, after applying this inequality repeatedly. 



(4.50) Ai<CiTP\\uofJ2^^ 



j=0 

Since 

* ^ „2a(K+l)T „4ar 

(4.51) J: e-- < e'-' = '-^^ < 

i=o i=o 

and e^"''^ — 1 > 2ar, we conclude that 

(4.52) A, <C2rP-i||Mof, 
that is, 

(4.53) max \\u{ti) -u,f < C^tP-'^W^lqW'^ , 

0<i<K 

where C2 depends only on T and the semi-group "iff In other words, the step- by-step 
approximation has order — l)/2 in time. The derivation of this result essentially 
relies on the following: 

(1) an approximation based on an orthogonal projection; 

(2) the property (14.481) of the solution operator. 

4.2.2. The Chaos Solution. Let us consider equation (14.211) on page [151 The approx- 
imation ulf(t) of the solution is based on an orthogonal projection in the space of 
square-integrable processes and, by Theorem 13. 6[ page [HI the solution operator for 
the equation satisfies (14. 48 p . We can therefore use (14.531) to derive an error bound for 
the step-by-step approximation of the solution of (I4.2ip . 

Let = < ti < . . . < tx = T he a, uniform partition of the interval [0, T] with step 
r: tj = jr, j = 0, . . . , K. Let {rrik, A; > 1} be an orthonormal basis in L2((0, T)) and 
mi{t) = mk{t - tj){xt,+Ai) - Xt.it)). We define 

(4.54) eM = r mi{t)dWe{t), 
and then, for a & J', 

(4.55) ^-Q,^a«(^M) 



Note that the random variables and are independent for different 
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If u = u{t; uq) is the square-integrable chaos solution of the homogeneous equation 
fl4.2ip with initial condition mq, then, by uniqueness and time homogeneity, we have 

(4.56) u{tj] Mo) = M(r; u{tj_i, Uq)), 

which is a particular case of the general relation (14 .42 p . Also, by Theorem 13.61 on 
page [HI 

(4.57) E||«(t;no)||^<e(^^+^-)*E||no||^, 
which is a particular case of fl4.48p on page [2U1 

Next, consider the following modification of the S-system fl4.25p from page| 



"(o)(^; /) = / + y ^u^o){s;f)ds, |a|=0; 

(4.58) oo , 

Kii'J)= Aui{s; f)ds + ^ y/oTe Bi,ui_,^^{s]f) {K,m{){s)ds 

•Jtj-x k,e=l 

for |a| > 0, where tj_i <t< tj, IE||/||h < C)0, and / is random but independent of 

a, « e X 

Theorem 4.7. Assume A1-A5. Then, for j = 1, . . . ,K, 

(4.59) u{tj; uo) = ^ <(tj; u{tj-i] Uo))^i 

and 

(4.60) muit,;uo)\\ii < e(^^+^^)^E||n(t,_i;no)||^. 

Proof. Since u{tj_i;uo) is independent of {^l^, a G J'}, Theorem 13.61 can be applied 
on each interval t-,], j = 1, . . . ,K, with uq replaced by u{tj-i]Uo). Then (14. 560 
becomes f H39|l and becomes flOTD . □ 

Define the multi-step approximation of u as follows: 

(4.61) uYit,) = J2 ^7it,-imL J = l,---,K, 

with u^^{to) = Uq. The following theorem provides an error bound for this approxi- 
mation. 



Theorem 4.8. Under the assumptions of Theorems \4.S\ and 4-4 



(4-62) 

+ ^EII^xoIIh + ^^n^oWh + 4r)E\\uo\\'ii ] ■ 

Proof. Since u^^{t) is an orthogonal projection of u{t; uq) on the span of ^a, « £ >^N^y 
and fOTjl holds, the result follows from fOg]) and fH35D . □ 
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Example 4.9. Consider the equation 

u{t) = Uq + Uxx{s)ds + X(xtM), < t < T, X G M. 

With only one noise driving the equation, we have u^^ = u^. Also, H*" = H''(R) is 
the Sobolev space fOSj) and H = L2(M). 

(a) If j£ is an Ornstein-Uhlenbeck noise with parameter 6, then Cb = (1 + Vbr)"^, 
(5 = 1, 7 = 2, (5i = 3, 7i = 4 (see Tabled]), so that fl4.62p becomes 

max^E\\u{t,;uo)-uYmu < T nuoVu 

(4.63) ' "'" ^ 

+ — E||mo||h + — E||mo|Ih2 



n-^ n 

(b) If X is an iJ-fractional white noises with parameter H G (1/2,1), then Cb = 
Ci{H)t^^-^ (see dOO]) ). 5 = (5i = 2i7, 7 = 71 = 3 - 2i/ (see Table [1]), so that fITOD 
becomes 

^ [j^^^y^ 

14.04 1 
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